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INTRODUCTION AND OVGRVIEW 

In general, evaluation ofi new instructional technology or 
delivery systems takes place according to three broad criteria. First, 
do the students exposed to the innovative mode of instruction "learn 
more" and/or "like it better" than the traditional mode of instruction? 
Educational psychologists would refer to the "learn niore" and "like it 
better" features respectively as the cognitive and affective characteristics 
of the new instructional approach. ^ Second, does the new approach cost 
the same as the traditional alternative while producing greater "learning" 
and/or "liking"? Does it cost more while producing less, and so on? 
This type of criteria relates to relative cost and is the legitimate 
domain of the economist. Third, do the students retain what they have 
learned with the new approach longer than with the traditional alternative? 

The authors are primarily concemed with the first two criteria 
in relation to the use of computer-assisted instruction CCAI) in economics. 
Specifically, we have developed an integrated set of interactive tutorial 
lessons and simulation games for use in the undergraduate principles of 
macroeconomics. These instructional materials have been implemented in 
a quasi-experimental context. The experimental results, in the form of 
student performance on cognitive and attitudinal measurement instruments. 



Actually observable human behavior has been divided by some 
educational psychologists into three taxonomic structures; (1) cognitive 
domain-includes knowledge and developed intellectual abilities and 
Skills. C2) affective domain-includes interests, attitudes, values 
appreciations and psychological adjustment, and (33 psychomotor domain- 
includes manipulative or motor-skill aspects of behavior [4 p ill] 
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cost, student characteristics, and instructional process characteTlstics 
form a data base to be examined relative to the two criteria in question 
Accordingly, our report on the results of an analysis of this data base 
is divided into two parts. This paper focuses primarily on the relative 
cost characteristics while a preceding paper [S] examined the cognitive 
and affective impact of the CAI materials. 

We believe that our analysis of the relative cost of CAI in 
the introductory macroecononii cs course has these unique characteristics: 
(A) a focus on the relative efficiency of the new approach as opposed 
to simply cost effectiveness, (B) use of attitudinal change as well as 
cognitive performance as a measure of educational output, and (C) the 
use of an experimental design and certain statistical techniques to 
derive a measure of the independent effect of the new approach on 
educational output. Each of these characteristics will be developed in 
turn. 

A, Efficiency in Education 

Several techniques have been developed in order to evaluate the 
merit of competing programs funded through the public sector. Each 
technique provides a ranking of alternative progrsjns according to a 
single well-defined criterion. The two most frequently employed are 
cost-benefit analysis and cost-effectiveness analysis. 

Cost-benefit analysis evaluates alternative programs through a 
two-stage process. First, the expected net future benefits Cexpressed 
in dollar terms) of each program are discounted to present value, 



Second, these present values are compared with the respective cost of 
each progTam and a ranking is formed on the basis of this comparison. 
For example, consider two conipeting programs A and B. Define the cost- 
benefit ratio (CBR) of a given program as 

$ Benefits 

CBR = F~F~T~ 

$ Costs 

Therefore, if CBR^ > CBR^ a rational choice on the basis of the 
criterion would be prograjii A. 

Where benefits from alternative programs cannot be measured in 
dollar terms, but a decision has been made to allocate funds for the 
purpose of obtaining' a' specif ied objective, the cost effectiveness 
approach provides a criterion. In general, cost effectiveness ranks a 
program on the basis of its cost, given that the program attains threshold 
leveXs relative to the objective. Following through with the example 
using programs A and B, if both A and B attain the specified threshold 

and the dollar cost CC) of each program is known, then, if C < Co 

A B 

a rational choice on the basis of this criterion would be program A. 
Presumably, if the threshold were specified such that neither program 
attained it, there could be no basis for choice with cost-effectiveness. 
Similarly, if the threshold were such that only one program attained it, 
cost becomes , irrelevant and that program is selected. 

While cost-benefit and cost -effectiveness analysis have been 
useful in evaluating alternative programs in certain areas, there are 
certain problems associated with applying these techniques to alternative 
approaches in education. In order, to employ cost-benefit analysis, the 



8 



4 

benefits must be e:<pressed in dollar terms. Clearly, there is some 
difficulty involved in atteinpting to ni0asure the dollar valuo of 
bgnefits from alternative instructional approaches, Because of this 
difficulty it appears that cost effectiveness would be the appropriate 
technique to employ in education. But there exists considerable 
dissatisfaction with this alternative. In particular^ while educational 
benefits may not be measurable in value [dollar) terms ^ they are often 
subject to measurement in other units. The use of cost effectiveness 
analysis implies the loss of valuable information insofar as it ignores 
the degree to which alternative instructional approaches achieve threshold 
levels. Note that the issue here is an appropriate specification of the 
threshold and an ability to measure performance in ralation to that 
threshold* 

The outcome of such dissatisfaction with simple cost effectiveness 
analysis has been increased use in education of an afficloncy ranking 
criterion. Over sixty years ago George Rogers Taylor defined Increased 
business efficiency as an increase in productivity at the same cost [IS] . 
Since then, educators have broadened the definition [3] by viewing it 

as a ratio of output to input: 

-I 

» Output 
Efficiency = input 

Efficiency provides a ranking criterion for alternative pTDgrajiis provided 
that for the alternative programs the measures of output are stated In 
the same units, and measures of input are stated in the same units. 
Note however, that neither measure must necessarily be in dollar terms. 
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In 1972, Bowon and Douglas substituted '^cost'^ for 'input'^ in 
the efficiency ratio [2, p. 3], This concept of efficiency is in a sense 
midway between cost benefit and cost effectiveness analysis. Current 
benefits, interpreted as output, are measured but not in dollar terms. 

With this background in mind, the educational efficiency ratio 
(EER) may be defined as follows: 

Educational Output 
fcOR ^ — Cost 

Used as a ranking criterion one would say that program A is educationally 

efficient relative to program B if EER > EER . 

A B 

B. Affective and Cognitive Output 
Evaluating a particular method of instruction on the basis of 
affective as well as cognitive output is appropriate in view of the 
ultimate objective of social science education in general and economic 
education in particular. That is, demonstrated cognitive ability is 
only meaningful to the extent that the student utilizes the acquired 
information or modes of analysis in examining social issues or problems* 
This is especially true of economics. However^ before students consistently 
employ economic theory as a framework for the analysis of social problems 
with economic characteristics they must not only comprehend basic 
economic concepts, but in particular they must be favorably disposed to 
their use and appreciate the contribution they can make. But if in the 
process of learning about economics students develop a dislike for the 
subject, it is unlikely that they will retain and apply acquired analytical 
techniques. Given this overall objective, it would not be appropriate 
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to ineasure thu uJiicat loiial output oC an i nst ruw' c ioTial njothoil in 
ecunomicH on the basis of coiMiitive ach i cvc^mant aluiiu. It is noeossnry, 
thereforu, For CM in economic^ to be ov:i\mtc\\ not only on the basis 
ui' cognitive output, but affect i\e ontjUJt as well, 

lUgruBsmk: briefly, it ifi nateworthv that although we will have 
little to say directly al^out the merit of in economics in relation 

to retention (i.e, the third general evahuninn criterion), it is highly 
iirobable that any instructional ajipruach tending; to foster favorable 
attitude ami hence repeated use of a subject matter will also foster 
ret On t ion . 

C. Measuring tlio Independent Output nffcct of CAl 
A primary objective in ovaluating a new method of instruction is 
the identification of a causal relation betweGn the new approach and a 
change in student cognitive performance a d/or attitude (i.e, cognitive 
and affective output). Both our ex]5erimental design and statistical 
procedures were oriented toward such an identification. 

In the experimental design, student subjects were divided into 
experimental and control groups, between which the only intended 
difference was experimental treatment. If there were no other differences 
between the respective groups, the new approach could be evaluated 
simply by a statistical test for difference in mean output between the 
groups. However, since other differences are almost always present, 
the statistical model most often used in economics education is least 
squares multiple regression. If the model is correctly specified, then 
the educational researcher is stat^ ist ical ly controlling for group 
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diffcroncos in variables other than experimentn 1 trontinont. Since, 
the experimental treat,„ont i, also a distinct variablo, such control 
serves to isolate the independent effect of the trc-n-ment (i.e. the 
new appro.chj an output. Therefore, using this approach it is possible 
to derive a measure of output that is due solely to the new instructional 
approach boina exnniirui.1, in this case, CM. 
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DESCRIPTION OF THE EXPERIMENTAL DESIGN 

A, Control and Experimental Sections 
The expeiiinental design for a three credit introductory economics 
course emphasized the substitution of computer assisted instruction CCAI) 
for the traditionai lecture-textbook assisted instniction CTAI). It 
involved two instructors each teaching a customary control and an 
experimental section. .An experimental section differecj from a control 
section in that students were given the opportunity to use the computer 
to the intensity of their choice. The design was quasi-experinieiital in 
the sense that the control sections Ccomposed of students in the TAI 
Introductor): Economics sections) and experimental sections (composed of 
students in the CAI Introductory Economics sections) did not have pre- 
experimental sampling equivalence. That is, students were not randomly 
assigned to individual sections, but rather they selected a given section 
primarily on the basis of scheduled class times. Each instructor's 
experimental section, however, was randomly assigned, There was no 
explicit infonnation provided to the students, either prior to registration 
or during the semestor. regarding their participation in an experinient. 

Students in the experimental sections had access to a Hewlett- 
Paekard 2OO0 C time-sh-ring system through thirteen terminals on campus. 
Each week, students in the CAI sections were presented with a "menu" 
which consisted of tutorial lessons, games, and simulations. Students 
were allowed to select freely from the weekly menus, but were encouraged 
to prococd through the weeks in chronological order and, within a week. 



13 



9 

to begin with the lowest numbered losson, game, or simulation, 
Tutorial lessons were conipletcd on an individual basis while simulation 
games could be played on an indivudual or team basis Cconsisting of a 
maximum of four players to a team). Throughout the sernester, students 
had the opportuiiity to complete fourtocn tutorial lessons, five games 
and one simulation. The computerized games and simulation were written 
in Beginners All-Purpose Symbolic Instruction Code (BASIC) language 
and the computerised tutorial lessons titilized Hewlett Packard*s 
Instructional Dialogue Facility (IDF).^ 

B, Scheduling of Sections 
The four sections in experimental design met in the same 
classroom during the 1974-75 fall semester. The control section of 
instructor 1 met for fity minute periods on Monday^ Wednesday and 
Friday at 1:00 P.M. .while his experimental section met for fifty 
minute periods on Monday and IVednesday at 2:00 P.M, Tlie Friday period 
was considered roleasGd time which stiidents could utilize as they 
wished*'^ The control section of instructor 2 mot for sevDnty-five 
minute periods on Tut^sdny and lluirsday at 2:00 P.M. while his experimental 

2 

"IDF enables an instructor with no programming knowledge to write 
lessons for presentatiun to students at computer terminals. For futher in* 
forniation see reference (7), The original mterials have been transferred 
from the HP aOOOC to the IIP ACCESS System, They are continually being 
updated and revised on the basis of our student experiencs. The complete 
set of revised CAT inaterials (including the control package which routes, 
records, and reports student CAI activities) can be obtained from the 
Center for HcgnQniic lulucation. University of IVisconsln-La Crosse, La Crosse, 
iVi scons in 54601 . 

'^If desired, students could have attended unstructured discussion 
sessions with the instructor during the released time. 
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section met for fifty minute pepiods on Tuesday and Thursday at 3:30 P,M, 
These shortened periods amounted to fifty minutes of released time per 
week resulting in similar released time for students in both experimental 
sections, but under different conditions. On several occasions , the 
weekly released class time was suspended due to exms or other extra- ' 
ordinary circumstances. 

Both instructors attempted, as much as possible^ to standardise 
classroom activities and grading policy. For example, clajs attendance 
was recommended, but not required. The same textbooks were used in all 
sections. Exams consisted of a common core of multiple choice items drawn 
from the UW-L Economics PrinciHes Test Bank^ and additional items selected 
by each instructor on an individual basis. Grades were based on total 
accumulated exam points. In addition, a maximum of ten bonus points could 
have been earned and were added to accumulated points after the grade 
boundary lines were drawn. Thus, the bonus points conceivably made it 
possible for a student to advance to a higher course grade. Bonus points 
u^ere earned by students in the control sections by completing specified 
tasks outside the classroom. In the experimental sections, bonus points 
were earned by students primarily for undertaking CAI oriented tasks. 

. 

^The UW«L Test Bank currently consists of over 2000 test items 
and is used by all instructors teaching principles sessions, Each item, 
when used by an instructor, is processed through a computer item analysis 
program at the UW-L computer center. The program provides a distractor, 
item difficulty, and item discrimination analysis for each item on an 
exam, as well as standard exam summary statistics* 
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C, Sffecr^ veness Considerations 
Effectiveness, as previously described, consisted of two 
components: affective and cognitive, In order to determine the change 
in economic understanding (cognitive change) which took place during 
the semester, students in all sections were administered both pre ..iid 
post TUCE (Form I, A and B), The TUCE is a validated, nationally 
normed exam [10, p, 7] . 

To measure changes in the affective domain^ attitude questionnaires 
were used. Pre and post instruments concerning student attitudes toward 
the subject matter were administered. Attitude toward the instructional 
process, however, was measured only in a post sense, S 

In attempts to avoid the introduction of unnecessary bias^ an 
agreed upon adininistration procedure was followed by both instructors 
before the measuring devices (TUCE and attitude quastionnaires) were 
administered. Every attempt was made to secure information on^ or hold 
constant, those characteristics which were thought to affect student 
performance on the measuring devices such as student characteristics, 
instructor characteristics, classroom environment and instructional 
approach. 

D, Cost Considerations 
The collection of dost information for the TAI sections did 



SAji attitudinal analog to the TUCE was not available. 
Consequently we used instnunents from various sources. These instruments 
are documented in Appendix A. 

1 0 
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not require any special consideration irthe experimental design. 
However, since the collection of cost information for the CAI sections 
was thought to present a more complex process, the experimental design 
included techniques for storing and retrieving data which related to 
operational cost such as computer time and data storage. Storage fees, 
obviously, depended on the a^nount of data stored. Computer time- for each 
student was entered and stored in the CAI facility (along with other 
information) in order to calculate this part of the operational cost. 

A second category of CAI cost, generally referred to as 
developmental, included all computer programinin£ related to the 
experimental sections. For the most part, these programming costs were 
associated with the control package (BASIC), computerized games and 
simulations (BASIC) and tutorial lessons (IDF). Each individual responsibl 
for some phase of prograjiming was instructed to keep track of the number 
of hours worked. 

Provisions for estimating other minor operational costs, such 
as administrative costs, were also included in the design. These costs 
were mainly in the form of "proctor" costs and were a function of the 
hours worked by the proctor and the hourly wage rate. 

Collecting cost data in this -anner allowed the cost of the CAI 
component of the experimental sections to be calculated on the basis of 
fixed cost Cdevelopmental cost), variable cost (operational cost) and 
total cost Cdevelopmental plus operational cost). 
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METHODS AND MEASUREMENTS 

A. Effectiveness Considerations 
In attempting to isolate either the affective or cognitive 
output associated with the experimental sections, the statistical model 
most often used is multiple regression analysis. The model is as follows 

n 

Y + I a»X. + bZ + e 

1 = 1 ^ 

where 

Y - performance measure 

^ control variable (i^l, n) 
Z diunmy variable representing the experiment 
e - error term 

The statisticar results of this mod^l determine which factors, other than 
experimental treatment, contribute to student perfDrmance, This 
determination depends on the statistical significance of the coefficient 
associated with each control variable. " 

1. Cognitive Performance 
Economic education research literature contains a number of 
studies which employ the general model presented above, A review^ of 
these studies reveal common elenients with resppct to model specifications. 



6See reference [S] for this review. 
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First, student peTformance is marly always specified as some form of 

cognitive achie\rement CCA). Second, the explanator)' variables are 
generally of two types; student characteristics (SC) and Instructional 
process (IP), it is recognized that CA is likely to be influenced by 
an interaction between SC and IP. However, it is generally felt that 
both SC and IP should be explicitly recogniied as being distinct 
although not independent. That is, 

CA a f CSC, IP) . 

In terms of SC, the models appBar to identify five distinct 
categories and one residual category: 
(A) General cognitive ability 

CB) Prior economic knowledge 

CC) Maturity 

CD) Motivation 

CE) Effort 

CF) Other Ce.g., sejc and major) 

General ability is associated with a student's verbal quantitative or 
critical thinking aptitude. Prior ecbnoniic knowledge may be related to 
previous fomal academic work in economics or non-formally acquired 
knowled|e.,,fro!n periodicals or newspapers, Maturity is very difficult to 
.^define and measure but is customarily associated with age or college 
class. Motivation is measured in terms of student attitude toward the 
subject matter and certain characteristics of the instructional process. 
Attitude toward the subject matter is measured both before and after the 
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instructional process, while attitude toward aspects of the instructional 
process is measured only in a post sense. The post process attitudes as 
they relate to SC "motivation" are thought to be an important source of 
interaction between the IP and CA as they are "channeled through" a SC. 
Effort is related to the ainount of time students spend studying as well 
a.: the efficiency with which they utilize their time. Finally, the 
residual category includes those .specif ic variables that empirical work 
has found significant but are not readily associated with the five 
specific categories. 

In terms of the IP we may identify three categories: 

CA) Instructor characteristics 

(B) Classroom environment 

(C) Instructional approach 

Instructor characteristics include such things as the extent of his 
training in the subject matter, attitude and value associated with the 
subject matter and generally the skill with which the material is 
presented to the students. Classrooni environment would relate to the 
physical characteristics of the instructional setting such as class 
size. Finally, the instructional approach is detennined by the delivery 
system and technology employed. For evaluation, the experimental design 
and statistical procedure are used to isolate and measure the independent • 
effect on cognitive performance of this last category of the IP. 

2, Affective Performance 
As previously mentioned, the additional specification of student 
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performance in terms of affective performance represents one of the 
unique characteristics of this study. A review? of the economic 
education literature dealing with student attitudes led us to place 
student attltudinal components in four major categories: interest in 
economics, importance of economics, attitude towaTd the instructional 
process, and attitudes regarding specific issues in economics. 

Our affective performance model assumes the same general form 
as our cognitive performance model: 

AP = fCSC, IP) 

where 

AP = Affective Performance 

SC = Student Characteristics 

IP = Instructional Process 
Previously four attltudinal dimensions of AP were identified. Of these, 
two were utilized; namely, interest in economics and importance of 
economics. 

While the set of control variables used in the affective model 
is similar to the set employed In the cognitive model, it differs 
primarily in the area of SC. The IP variables are retained in their 
entirety and treated in exactly the same manner as in the cdgnitive 
model. SC, on the other hand, are grouped in four distinct categories 
and one residual category: 



7 s 



See reference [S] for this review. 



21 



17 

(A) Prior Economic Knowledge 

(B) Maturity 

(C) Perception of the Instructional Process 

(D) Dissonance 

(E) Other (o.g,, sex and major) 

In our cognitive model we identified six categories compared 
with only five for our affective model. Three categories (prior 
economic knowledge, maturity and other) are common to both models, 
and as such, retain the same interpretation. Student perception of the 
instructional process is multi-dimensional involving attitudes toward 
the method of instruction/ course content , and the instructor. 

While the four mentioned categories involve a simple inter- 
pretation^ the dissoitance category Is more complex, In general, it 
refers to the fact that through the educational process, students are 
freed from an illusion concerning their expected performance. IVe believe 
students enter a course with an illusion as to how they will perform 
relative to their peers, and that this expectation of personal performance 
is conditioned by the students* environment. If students do not achieve 
the expected performance levels in any given course they will tend to 
develop an unfavorable attitude posture toward the course in question. 

As in the cognitive case, the experimental design .and the 
affective regression model were used to isold|e and measure the 
independent effect that CAI has on affective performance. 
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B. Cost Considerations 
Since a clear specification of cost categories is crucial to 
an>' satisfactory cost study [6] , we have attempted to identify each 
major cost category relative to our study. First, both the coiitrol and 
experimental sections involved direct operating costs. These costs 
are defined^ according to the following categories i 

1) Compensation (salaries , wages and benefits) 

2) Supplies and services 

3} Equipment paid for under operating budget 
4) Department level administrative costs, 
labile the calculation of costs for the control sections was 
simply a summation of the above four categories, the calculation of 
costs for the experimental sections was more complicated. Experimental 
sections involved both a TAI and CAI component . The ,TAt cost components 
of the experimental sections could not be calculated as a single figure 
but rather were calculated under two different conditions and reported 
as lower and upper bound cost estimates. The lower bound cost figure 
was calculated as a two-thirds proportion of the control section costs 
while the upper bound figure required a four-fifths proportion. The 
two-thirds and four-fifths proportions were based on fifty and thirty 
minutes of released class time per week, respectively, Lower and upper 
bound figures were calculated because weekly released class time was 
suspended on several occasions during the semester (See Part I, B, of 



^The definition used for direct operating costs is described by 
Leonard Romney, Jim Topping and Charles Manning [14]. 
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this paper) which made an exact released time calculation uncertain. 

The CAI component cost categories were grouped according to 
developmental and operational costs. Developmental costs included the 
following categories: 

13 Instructional Design CGames, Simulations ^ and Tutorial 
Lessons) 

2) Data Management Programming [Control Package and 

Reporting Files) 

3) Game and Simulation Programmin| (BASIC) 

4) Tutorial Lesson File Construction (IDAF) 

5) Computer Usage CTime, Storage and Supplies) 
Operational costs included the following categories; 

1) Proctor Time 

2) CAI Computer Usage CTime, Storage, and Supplies) 
Whereas specification of those cost categories presented few 

problems, a number of conceptional problems were encountered when 
attempts were made to assign dollar figures to the cost categories. 
Each individual who was expected to make a major contributioh to the 
development of the CAI materials was asked to keep a record of time 
expended. Obviously this information would be used to calculate the 
personnel cost (which was expected to constitute- the major expense of 
CAI) associated with developmental costs of the CAI materials. At this 
point a question arises as to which dollar figures ought to be employed. 
If actual salaries of the participating personnel are used and these 
individuals tend to be in the. higher (or lower] academic ranks with a 
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large (sniall) number of experience years, the developmental cost would 
be over (under) stated. In this sense we might unintentionally be 
providing misleading information to those in the educational community 
who are considering producing and utilizing similar CAI materials. 
This problem can be avoided to some degree by using a salary which is 
a departmental average or some type of national average.^ On the 
other hand, actual cost data both for reporting TAl and CAI components 
are important features of this study. Our cost data utilizes actual 
faculty salaries because the average salary of participating faculty 
was nearly identical to the departmental average, and within $100 of 
the national average for college and university faculty in general. 

Another conceptual prohlem, more fundamental to CAI studies 
in general, involves the reporting of developmental costs. Basically, 
the CAI component of our experimental sections is composed of fixed 
costs (developmental costs) and variable costs (operational costs). 
The fixed costs represent a ^ons time only' expenditure and probably 
should be spread over the life of the CAI materifils. But this presents 
a problem since it requires a determination of the life expectancy of 
the materials. Such a determination is not a simple matter. For 
example, one can compare economic CAI materials with leading economic 
textbooks which are revised approximately orre in every three years. 



Some cost studies have attempted to avoid this problom by 
reporting the hours expended along with dollar figures (13) This 
procedure does not solve the problem entirely since the efficiency of 
the personnel involved in the project will influence the amount of hours 
expended. Furthermore, certain costs associated with CAI cannot be 
e^ressed in units of time which creates an aggregation problem 
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In most cases, these revisions are minor, leaving most of the material 
intact. Hence three years would not represent the true life span of 
an economic textbook, nor TOuld such a short duration represent the . 
life expectancy of economic CAI materials. Obviously, a changing 
economic world and new economic theories mean a shorter life span for 
economic CAI materials than for, say, CAI materials dealing with a 
foreign language or mathimatics. We were unable to specify the time 
period over which our CAI materials will be useful; therefore, two 
additional conditions were used for calculating cost for the experimental 
sections. One condition assumes infinite life for the .CAI materials 
and excludes developmental cost, while the other assumes a one! semester 
life for these courseware and includes developmental cost. 

C. Estimations of Effectiveness and Costs ' 

1, 'Effectiveness Estimates 10 
As indicated in Section I, one of the unique characteristics 
of this study is the use of an experimental design and associated 
statistical technique to derive a measure of the Independent effect of 
a new instructional approach CCAI) on educational output. Student 
subjects were divided Into separate treatment groups and parameters of 
linear models meant to explain their cognitive and affective performance 



lOme Statistical foundations for this section are presented 
in Johnston [8, pp. 38-41 and 1S2-1S4] . 
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weru estimatca by least squarcr. multiple regression. For our purpofics 

the snlient chnrncteri.^tic of this approach is the presence of cxperifnentnl 

treatment as a 0-1 dununy variable. 

Recall irom Section II, Part A, the linear motlGl is specified as; 
n 

V ^ a + I a.X^ ^ + e 

where 

Y ^ Output Cpcrfomance) measure 

" Control [independent) variable 
2 - dummy variable representing experimental treatment 
c « error term 

If the model is correctly specified, the coefficient (b) associated with 
the treatment variable (Z) may be interpreted as the amount by which 
educational output is altered because of experimental treatment after 
allowing for the effect of other output-determining variables (XJ and 
random errors (e) , 

Those estimated linear models were used to predict cognitive 
and affective educational output,^ ■ That is, our sample data set was 
used to make inferences concerning the mean value of educational output 
from our student population both with and without experimental treatment. 
Operationally, this involved setting the dummy variable equal to one 



See Appendix B for the regression statistics and mean values 
of'^he independent variables. 
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and setting all romaining imiopendent variables equal to their mcnn 
samplo values, and then gcncratini^ an output prediction from the model 
on the basis of the estimated parameters. For purposes of compariaon 
this procedure was ropcatod with the dummy variable net equal to -ero. 
Kith the treatment dummy equal to one, the predicted value ib interpreted 
as an unbiasod estimate of the moan value of output for the average 
student (in our population) having been subject to the experimental 
treatment. Correspondingly, with the treatment dummy equal to zero, the 
predicted value is interpreted as an unbiased estimate of the mean value 
of output for the average student not subject to the experimental treatment. 

Table 11,1 presents these predicted output values (Y) with both 
cognitive and affective output examined in terms of composite measures 
and certain distinct sub-measures* 

The most noteworthy feature of the information contained in the 
table is the uniformly higher predicted output for the experimental 
sections. This result simply mirrors the fact that the estimated 
coefficients associated with the treatment duimny were positive. 

If we assume that the random error term (e) in the model is 
normally distributed with zero mean and constant variance, the predicted 
output value will also be noraally distributed. In the absence of exact 
knowledge of error variance, an estimate of error variance based on 
sample residuals may be used to specify a standard error for the predictad 
output value. These standard errors are also shown in Table 11,1. 
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Table 11 a 
Predicted Ilducational OutpMt^ 



Ty])e of No iixperimental Experimental 

Q^^P"^ Troatment Treatment 



Cognitive Performance^ 


Y 


S.E, 


Y 




S.E, 


Recognition Understanding 


7.35 


0. ly 


7 


.44 


0.19 


Simple Application 


4.73 


0.22 


S 


.72 


0.23 


Composite^ 


18.06 


0.48 


18 


71 


0.49 


Affective Performance'' 
Importance of Economics 


11.85 


0.21 


12. 


21 


0.21 


Interest in Economics 


10.59 


0.27 


10. 


72 


0.27 


CompositeS 


36.94 


0.65 


37. 


52 


0.65 



Predicted educational output can be calculated using data supplied 
in Appendix B. However, rounding of regression coefficients will 
result in minor differences in output values in several cases. 

2 • • 

Cognitive performance is measured on the basis of post-TUCE score. 
See references [10] and [12] for a description and evaluation of this 
instrument. 

Includes score on complex application question, 

^Affective performance is based on attitude instra-nents documented in 
Appendix A. 

-Includes attitudes toward the subject matter of economics in general 
which includes importance, interest and other factors. 

Furthermore, on the basis of the sample standard error, the t distribution 
may be employed to establish "prediction intervals". In other words, 
confidence intervals may be formed for the population mean on the basis 
of the predicted values from the sample, Upper and lower bounds for 
these prediction intervals will be of use in parametrically examining 
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the educational efficiency Cor lack of it) of the CAI materials. 
Table 11.2 displays the upper and lower bounds of 9S% prediction 
intervals for the sample predicted output values in Table II. 1. 



Table 11.^ 

Predicted Educational Output at 951 Prediction Intervals^ 



IfP® °^ " No Experimental Experimental 

^-P"^ Treatment Treatment 



Cognitive iSHSI UEEI£ Lower 

Recognition 5 Understanding 7,73 6,97 7.82 7,06 

Simple Application S.17 4.29 6,18 5,26 

Composite 19.01 17, U 19.68 17.74 

Affective 

Importance 12.27 11.43 12.63 11. 79 

'"<^"est 11.12 10.06 11.25 10.19 

Composite 38.23 35.65 38.81 36.23 



Ino. of OBS. = 113; No. of Indep. Var. = 11; Prediction Interval = 
e/2 ' St3J^dard error; e = 0,05. 

The most noteworthy feature of Table II. 2 is the non-overlap 
of the prediction interval for the simple application question on the 
cognitive instrument. All other prediction intervals between the 
treatment groups overlap at the 95% level. Therefore, it would appear 
on a predicted output basis, at the five percent level of significance, 
the experimental treatment is statistically significant only for 
cognitive output of the simple application type. 



30 



2. Cost Hstinwites 
KstiniLiting costs for the two control sections presented 
few problems since these sections involved only a TAI component. 
Therefore, the relevant costs were secured directly from the UW- 
La Crosse budget. Using the categories luentified in Part III, 
B, Table 11,3 was constructed , 

TABLi; 1 1. 3 
listimated Costi; of Control Sections 



Cost Categories 




Cos 


ts 


Costs/Student 


Compensation 




$4612 


.00 


$57.65 


Supplies and Services 




175 


.00 


2.19 


Equipment 




22 


.14 


.28 


Administration 




1S3 


.83 


1.92 


TOTAL 




S4962 


.97 


$62.04 



Table 11.3 presents both total dollar costs and per student costs. 
This latter cost figure, $62.04, was based on 40 students per sec- 
tion, meeting 150 minutes each week. 

In order to check on the validity of these costs figures^ 
a per student credit cost was calculated by dividing the cost per 
student by 3, the number of credits. This cost, $20.78, compared 
very favorably with per student credit costs calculated by the 

University's administration for lower division economic courses. 

The measurement of costs for the experimental section 
was not as straight forward as the calculation of costs for the 
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control soctions. Since the experimental soctions involved both 
TAI and CAT components, costs of the two cxporinientnl sectioi s 
nciturally retlocted bt>th tx]ies of costs* Likewise, n greater degree 
of difficulty was encountered in estimating the costs associated with 
the experimental i^ecilon:^. Tabic il.4 presents the costs associated 
with the IM component of the experimental sections and utilizes 
the samo cost cntegorios as the control sections. The lower bound 
costs per student were bajed on a 40 student section with fifty 

TABLE II. 4 

Estimated TAI Costs of Oxperimental Sections 



Lower Bound Upper Bound 

Cost Categories Costs/Student Costs/Student 



sensation $38,43 $46,12 

Supplies and Services 1,46 1*75 

Equipment Mg ,22 

Administration 1,28 1.54 

TOTAL S41.56 $49.63 



minutes of weekly released class time. Thereforej the lower bound 
cost figures were simply calculated as two-thirds of the control 
section costs iof each cate;3ory. LikewisCs the upper bound cost 
figures were calculated as four-fifths of the control section costs 
and represents thirty minutes of released class time* Table 11*4 
presents both lower and upper bound cost estimates of $41.36 and 
$4 9,63, respect ively . 
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Tho cost estimatos of the CM component of the experimental 

sections utilizod the cost catogorios previausly identified, nnd 
involvod the use of hourly calcul ntions for all categories except 
computer storage and supplies. Table II. 5 indicates that the CAI 
cumponent of tho experimental sections cost an estijiiated $9187. on. 
Of this figure, developmental costs were $7269.00 [or approximately 
80 percent of the total cost) and oporational costs wore $1918.00. 
As expected, Table II.S reflects the fact that personnel cost consti- 
tute the major share of developmental costs. Personnel costs, in 
the form of salaries, wages and fringe benefits amount to $6421.00, 
or approximately 8S percent. 

While the developmental costs of our CAI courseware represented 
80 percent of >:otal costs, Rogers and Weinstein (13) indicated 611 
of total costs were in the form of developmental costs. On the other 
hand, LittrcU's study (11) reported developmental cost as 95% of total 
costs. The relatively low figure reported by Rogers and Weinstein 
may be explained by the fact that their project was actually computer 
managed instruction (CMI) rather than CAI, and a rather high hourly 
computer usage rate ($6 . 09/hour) . Since a time sharing system was 
used at U'.V-La Crosse, our relatively lower operational costs probably 
reflect the significantly lower computer usage rate ($1.7S/hr.). 
LittvGll's developmental costs reported CAI costs, but also included 
costs for the development of films, graphics and audio materials. 
In comparing personnel costs as a percent of developmental costs. 
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TARLi; IK5 

listirnatod CAI Costs of l-xpcr imontal Sections 



Estimated Time Total Hstiniated Total 
Type of Cost.^ in Hours Hours Costs Costs 



DBVLiLOPMENTAL COS^ 

Instructional 
1 



Design 

Faculty & $3.20 243 243 $1993.00 S1993.00 



1 

ProgramiTiinf;" 



Faculty^ S8.20 91 746.00 

Students Q $1.90 138 229 262.00 



1419.00 



File Construction '^ 

Faculty $8.20 1 73 

Classified Per- igs " Iq[qq 

sonnel Q $5,00 ^ 

Data Managenient 
Design 

Faculty *3 $8.20 35 287,00 

Classified Per- 26_ 61 130.00 

sonnel il $5,00 — ~ — ' 

5 



(Table 11.5 continued on following page) 



1008.00 



1469.00 



417.00 



Programming ' 

Faculty ff $8.20 164 1345.00 

Class. Per, 8 SS.OO 6 30 00 

Student § $1.90 ' _84 254 159.' 00 1534.00 

Computer 

Usage^ ^ Si. 75 454 454 794.50 

§l2msJ 50.' 00 

imHB^ 3.00 848.00 

Total Dovelopmental Costs $7269 00 



TABLi: II.S (continued) 
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Type of Costs 

OPIilUTIONAL COST 

Proctor " 

Student 5 $1 .90 

Computer 
' Usage i1 SI , 75 
Storage 
Suppl ies 

Total Operational Costs 



natiniated rime Total listimated 
in flours Hours Costs 



857 



70 



857 



133.00 



1500.00 
233.00 
62,00 



Total 

Costs 



133.00 



$1785.00 



$1918.00 



TOTAL COST OF CAI 



$9187,00 



1, 

instructional desigriing included the development and/or modification of 
14 tutorial lessons, 4 games and 1 simulation. 

2 

Instructional programming involved only the games and simulations and 
was in BASIC. 

'^Instructional file construction concerned only the tutorial lessons and 
util ised IDAF. 

4 

Data management designing included the development of the Integrated 
Tutorial and Came Management System (ITGMS). ITGMS consists of 9 
programs and 3 files, 

^Data management programming of ITGMS. 

Computer usage charge for the 2000C* Hewlett Packard Time Sharing 
,Computerwere established at 51.75/hr. by the UW^L Computer Center, 

'computer storage charges were assessed at S . 03/block/month by the 
m-L Computer Center. 

Computer supplies consisted of terminal paper and ribbons. 

9 _ 

The duties of the proctor included the opening of necessary files 
entering and dropping students for the course, requesting various' 
reports, entering daily messages if necessary, clearing the News 
file, and the assisting of students at computer terminals. 
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Rogt^rs and WeinstQin ruportCLi S: percent and LittroU reported 81 
percent. Our figure (88 percent} is slightly higher and probably 
reflects the fact that our pcr^;onnel costs include fringe benefits 
while tiie other two studies excluded these benefits. 

The QStimatod costs per student for the three major areas 
of CAI are presented in Table II. r -se costs were calculated 





TABLH IT. 6 




Est i mated CAI 


Costs Per Student 


of Experimental 




Sect ions 




Major Area 


Cost 


Cost/Student 


Developmental 


S7269,00 


S 91 ,00 


Operational 


1918.00 


24 .00 


TOTAL 


S91S7.00 


$115.00 



using the same number of students used for calculating costs per 
students for the control sections* 



Given the difficulty of calculating the exact amount of 

released class time and the conceptual problems associated with the 

developmental costs of CAI courseware, costs of experimental sections 

were estimated under four separate conditions. Table 11,7 presents 

the cost per student under each of these conditions: 

1» Condition I assumes fifty minutes of released class 
time per week and infinite life for CAI materials 
(i.e,, developmental costs excluded), 

2, Condition II assumes the same released class time as 
Condition I, and a one semester life for CAI materials 
Ci,e,, developmental costs included) , 



36 



32 



5. Condition III assume^; thirty minutes of relcnseci 
clasH time per week and infinite life for CAI 
mntur ial s , 

4. Condition IV assumes the same released class time 
as Condition III and a one scmoster life for CAI 
inaterials . 

TABLi: 1 1. 7 

Estimated Costs of nxperiniental Sections 
Under Various Conditions 



Component 








Condit ions 








I 


II 




HI 


IV 




TAI 

Lower Boiind 
Upper Bound 


$41 


.36 


S 41 


,36 


S49.63 


$ 49. 


63 


CXI'-'' 

Operational 
Total 


24 


.00 


lis. 


00 


24.00 


115. 


00 




$65 


.36 


$156. 


36 


$73.63 


1164. 


63 



No matter which set of assumptions we use, the estimated 
costs of the experimental sections exceed the cost of the control 
sections. When comparing Table II. 3 and Table 11.7, it is found 
that under Conditions I and III, the costs per student exceeds the 
control sections hy $3.32 and $11.59, respectively. Under Condi- 
tions II and IV, the costs per student are over twice as high 
as for the control sections. Therefore, solely on the basis of 
educational input costs, CAI is more expensive than TAI, This 
is not to say, however, that TAI demonstrates greater efficiency. 
In order to assess the efficiency of the two teaching strategies, 
educational efficiency ratios must first be calculated. 
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. III. 

RliSULTS OF Tlin INVliSTrGATION 

One of the unique characteristics of this study is the 
calculation of education efficiency ratios (EER) for the purpose of 
evaluating instructional delivery systems. As previously defined, 
an Em is the ratio of educational output to cost. For the purpose 
of this study, educational output included both cognitive and 
affective performance. 

A, Efficiency and Cognitive Performance 
Efficiency results associated with cognitive performance under 
CAI and TAI delivery systems are presented in Table 111,1, Cognitive 
EERs were calculated for three categories: recognition and understand- 
ings simple application, and composite (overall TUCE score). Table 
lira presents EERs for both upper and lower bounds of 95% prediction 
intervals and for various cost estimates associated with the CAI 
delivery system. 

A comparison of EERs indicates that TAI is of equal or 
greater efficiency than CAI for both upper and lower bounds under 
all cost conditions, with one exception. In the area of simple 
application under the assumption of fifty minutes of released class 
time per week 'and excluding developmental costs CCondition I), CAI 
was found to be more efficient. In addition, TAI and CAI were found 
to be equally efficient in the areas of recognition and understanding 
under the assumption of Condition I, and simple application under the 
assumption of Condition III (assumes thirty minutes of released class 
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taiuj: 111,1 

Oducational Hfficicncy Fiatios 
(Cognitive Pei-formance) 



EXPERIMENTAL 



TYPE OF OUTPUT 



Condit ion 
CONTROL I . 



Condit ion 
II 



Condition Condition 
in IV 



RU' 



Lower Bound 



SA' 



Upper Bound 
Lower Bound 

Co'p osite 

Upper Bound 
Lower Bound 



. 12 
.11 



.08 
,07 



.31 
.28 



,12 
,11 



.09 

.08 



,30 

27 



.05 
.05 



.04 
.03 



.13 
,11 



,11 

,10 



.08 
.07 



.27 
.24 



.05 
.04 



.04 

.03 



.12 
.11 



1 



EERs were calculated from cognitive data presentod in Table II. 2 
and cost data presented in Tables II. 3 and II. 7, 

I 

'RU = Recognition and Understanding. 



3,, 



SA = Simple Application 



time per week and excludes developmental costsj- ^ IVhen using costs for CAI 
under Condition 11 Cassumes fifty minutes of released class time per 
week and total cost of CAI materials) and under Condition IV [assumes 
thirty minutes of released class time per week and total cost of CAI 
materials), TAI was found to be more efficient in all cases. 
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While CAI under cost Condition I was of greater or equal efficiency 
for simple application, it was less efficient for the composite. The 
reason for this apparent paradox is that the composite includes a 
number of test items which supposedly evaluates the studenrs' ability 
to apply two or more concepts simultaneously, 
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3. EfficiDncy and AffDCtive Performance 
While the [U-Rs concorning cognitive porformance Huggestcd 
somewhat mixed efficiency results between TAI and CAI delivery systems. 
Table III. 2 indicates that in the area of affectivo perforinance CAI 



TABLE 111.2 



Educational Officiency Ratios^ 
(Affective Performance) 



nXPERIMENTAL 



TYPE OF OUTPUT 


CONTROL 


Condition 
I 


CondTtion 
II 


Condition 

in 


Condition 
IV 


2 

Importance 












Upper Bound 
Lower Bound 


.20 
.18 


.19 
.18 


.08 

.08 


.17 
.16 


.08 
.07 


Interest" 












Upper Bound 
Lower Bound 


.18 
.16 


.17 
. '6 


.07 
.07 


.15 
.14 


.07 
.06 


Composite 












Upper Bound 
Lower Bound 


.62 

.57 


.59 

.55 


.25 
.23 


.§3 

.49 


.24 

.22 



EERs were calcul ated using affective data presented in Table II 2 
and cost data presented in Tables 11,3 and II. 7 ' ' 



■Importance refers to importance of e 



conomics 



Interest refers to interest in e 



conoinics 



failed to achieve an efficiency level greater than TAI for all cases 
considered. Under Conditions II and IV, CAI achieves especially low 
EERs relative to the EERs associated with TAI. 
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Proponents of CAI can find little comfort in Table 111.2 
with two minor exceptions. In the area of Importance of Economics, 
under Condition I, CAI was found to be equally efficient at the 
lower bound. Likewise, Interest in Economics was found to have the 
same EERs of .16 at the lower bound for both CAI and TAI. 
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IV. CONCLUSION 
In evaluating the relative educational efficiency of CAI 
we have adopted what might be called a "parametric*^ approach. 
Essential ly we have attempted to determine under what conditions 
CAI is educationally efficient (cognitively and affectively) in 
relation to TAK Our results indicate that under virtually all 
circumstances considered, gains in educational output did not 
outweigh the additional cost of CAI. In fact, the only circum- 
staiices in which CAI appeared marginally efficient required us 
to ignore the developmental cost of the CAI materials] a cost 
component generally acknowledged to represent the principal share 
of total CAI cost. Therefore, on the basis of our results we are 
forced to answer the question posed in the title of this paper 
affirmatively. 

Given that our set of CAI materials was not cost efficient ^ 
the next logical step is to consider the following question: Are 
there any areas where CAI costs might be significantly reduced? First, 
it is known that experience in the construction of CAI materials has 
a significant impact on developmental cost. Therefore, a reduction 
in this cost component would be expected as authors of CAI materials 
gain relevant experience. In our case, efficiency in writing com- 
puterised tutorial lessons and simulation games had improved markedly 
by the end of the project. 

Second, advances in computer technology may have an impact on 
CAI costs. Conceivably, new hardware and methods could reduce both 
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the developmental and operational costs of CAI. 

With respect to educational output in economics, we feel 
that our models of cognitive and affective output represent the 
current state of the art in modeling of the learning process in 
Principles of Economics, However, this is not to say that the 
current state is satisfactory in all respects. If the models 
are fundamentally mis^specif ied or the variables are^subject to 
serious measurement error it is conceivable that our outputs 
are under (over) estimated. 

Finally, it must be stressed that CAI is not monolithic. 
That is, there are significant differences in the quality of 
CAI materials. While we naturally feel that our materials are 
relatively "good*% as educators gain! experience in instructional 
computing the quality of CAI materials will improve* Further- 
more, it must be stressed that our results pertain in particular 
to the educational efficiency of CAI in the Principles of 
Macroeconomics, While we believe that the logical structure of 
economic theory naturally lends itself to CAI there may be other 
disciplines for which such a claim is stronger. 
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APPENDIX A 
Attitude Survey 
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Appendix A 



The Course Evaluation Questionnaire was based on the 
Illinois CEQ: 

Aleamoni, L.M,, ^^Illinois Course Evaluation Question 
naire CCEQ) Results Interpretation Manual Form 66 
and 32." Report #331. Urbana, Illinois: Office 
Instructional Resources, University of Illinois 
1972, 

The Atttitude Evaluation Instrument was based on the 

Karstensson instrument documented in: 

Karstensson, L., »'A Study of the Validity and 
Reliability of a Questionnaire on Student 
Attitude Toward Economics J* Athens^ Ohio: 
Department of Economic Education, Ohio 
University, 1973* 
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COURSE EVALUATION 
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INSTRUCTIONS i 

objective ri-.ponru.. t., e\ch it J PImso do your best to give a considered. 

""e:n;i;nr?o?r;o;rS:=" ^^^^ «...™.nta ,.^o. according to 



A if you M.mMliL^iM££ wich clie item 

B if you nyj^ m„dciatt-Jy with the item 

C If yoii lU^reo nederntulv with tho iti 

D If you sLronnlv (ii^nr>_r co with the icum 



2, 



4. 



11 , 



1. I would rahc another courHc that was taught thlf^ way. 

The in.rrucror seamed to be int.rc.tad in students a. persons, 
3. I would hav. preferred .noth.r method of teaching in this course, 
It wnR cony to rc^nuln attentive. 

5. Th. instructor did NOT sy,uh.«i.e. Intogr.t. or su^arU. .ff.ctlv.Jy. 

6. NOT niuch wiiH grtini-d by taking this courKe. 

^ Tho ln.t.u=u,r .ncour.R.d th. d.valop.ont of new viewpoints and appreciations. 

8. I learn mure- whun other teaching mothods arc used. 

9. The? course matfrlal sypmed worthwhile, 
10. More courses shniild be triughl this way. 

Th.i iMHirucior domoustratcd „ thorough knowledge of Che subject matter. 
The way in which thU course wa« taught renults in better student learning. 
13. It wau a very u't*r t liwh i 1 e course. 
1^. Same Ehings wc-re :;0T OKpIained verv well. 
13. 1 would prefpf a different method of instruction. 

16. The course material was too difficult. 

17. ThiR in one of my poorest courses 

18. Another m..thod of instruction should have been employed. 
19*^* It way quite Leresiins- 

20. T think that tlH^ courue w^^ taught quite well. 

21. TYm courf,^ ct^ntont wa?; excellent, 

22. So^o days I w,u, NOT very interested In thi. .our.e. 

23. It was qui rcj boring. 

2'<. tX-trall, thf ..jrse v,„ f^od. 

Tqp: : ^r:^'-;::';'jr-;^^;\'::',:;:'r'-' ---- - - - 

C. Aver.i»;i» 

D. Ahovn Avt rai'u 
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ATTITUDE SURVEY 



II 
III. 



INSTRUCTIONS : 

1. Write the following information at the top of an IBM answer form: 

Name 

Course 

Section 

Date 

Attitude Survey 

Enter your six-digit Alpha number in the ID block according to 
your Professor's instructions. ii uu 

Your frank response on each item of this opinion survey will aid 
the instructor m the improvement of this course. ' 

Please Indicate your agreement or disagreement with the first 
ten statements according to the following scale; 

A = Strongly Agree 
B = Moderately Agree 
C - Neither Agree nor Disagree 
D = Moderately Disagree 
E = Strongly Disagree 

How would you rank economics in comparison to other subiects 
subject? °" °^ personal interest in the 

A. one of the most interesting subjects 

B. Among the more interesting subjects 

C. Undecided or indifferent 

D. Among the less interesting subjects 

E. One of the least interesting subjects 

How would you rank economics in comparison to other subiects 
education? °" °^ contribution to your general 

A. One of the most important subjects 

B. Among the more important subjects 

C. Undecided or indifferent 

D. Among the less important subjects 

E. One of the least important subjects 

How would you rank economics in comparison to other subiects 
you have studied on the basis of its contribution to your 
occupational preparation? ■ 

A. One of the most important subjects 

B. Among the more important subjects 

C. Undecided or indifferent 
p. ^jnong the less important subjects 

^ E. One of the least important subjects 
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Is the knowledge which you obtain fram studying economics worth 
the time and effort that you put into studying the subject? 

A, Definitely yes 

B, Mostly yes 

C, Undecided or indifferent 

D, Mostly no 

E, Definitely no 

To what extent are you interested in learning (or learninF more) 
about economics? / 



A, Very interested 

B, Somewhat interested 

C, Undecided or indifferent 

D, Not too interested 

E, Not at all interested 

To what extent are you interested in taking additional course 
work in economics? 



A. - Very interested 

B. Somewhat interested 

C. Undecided or indifferent 

D. Not too interested 

E. Not at all interested 

Do you intend to take additional course work in economics within 
the. next two years? 

A. Definitely yes 

B. Probably yes 

C. Undecided or indifferent 

D. Probably no 

E. Definitely no 



What is your present inclination toward recomraending a course in 
economics to a fellow student who has never studied 'the subject? 

A. Definitely would recommend course 

B. Probably would recommend course 

C. Undecided or indifferent 

D. Probably would not recommend 

E. - Definitely would not recommend 

Do you agree or disagree with the following statement? ^'Economic 
understanding is essential If we are to meet our responsibilities 
as citiEens and as participants In a basically private enterprise 
economy , ^ f ^ . ^ 



A* Strongly agree 

B, Agree 

C, Undecided or indifferent 

D, Disagree 
Strongly disagree 
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10, row would you describe your present attitude toward the subiect 

of economics? 

A. Very favorable 

B. Mostly favorable 

C. Undecided or indifferent 

D. Mostly unfavorable 

E. Very unfavorable 
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APPENDIX B 
Regression Results 
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DEFINITIONS OF ABBREVIATED INDEPENDENT VARI.^LES 



HSRANK 

High School Rank in Percentile 
PRETUCE 

Pr&Test of Understanding in College Economics 
PRETRU 

Recognition and understanding component Test of 
Understanding in College Econoniics 

PRESTA 

Simple application component of Tost of Understanding 
^ in College Economics 

AGE 

Chronological age in years 
EVALTT 

Course evaluation composite 
CHigher score/ better evaluations) 

CURCRE 

Current semester credit hour load 

SEXF=1 

Sex - 0-Male, l=Female 

SBAMsl 

School of Business Administration majoral 
Non School of Business Administration major^O 

LABNNl 

Science major»l 

(Includes: Biology, Chemistry, Physics^ Math) 
Non^Science major=0 

SSM^l 

Social Studies major=l 

(Includes: Psychology, Sociology, .Anthropology, G&o^va 
Political Science) a/ . s ^ 

Non-Social Studies major=0 

INS 1*1 

Instructor Dummy Variable 
Instructor A^l 
Instructor BsQ 
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EXP=1 

Experimental treatment - Uununy Variable 
Control Sections^O 
Experimental Sections=l 

DISSON 

Dissonance: The difference between where a student thinks he 
ought to rank on exams based on previous experience, and 
where he actually ranks based on exam scores. 

PREATT 

Pre-test of Attitude Toward Economics. Composite includes importance, 
interest, and intent to take more classes in economics. 

PRE IMP 

Import^Hnce of economic component of pre-test of Attitude Toward 
Economics , 

PREINT 

Interest in economic component of pre-test of Attitude Toward 
Economics* 
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TABLE B,5 

Mean Values for Independent Variables 
Used in Cognitive and Affective Models 



Independent 
Variable 






Mean Value 




Cognit ive 


Affective 


HSRANK 






" " ~ 


PRETRU 




A lien 
4.41 by 


"" ** ~ 






3. 7322 




PRETUC 




11 .1239 


11.1239 


PRE I MP 






12.4425 


PREINT 






11.6637 


PREATT 






39.5398 


AGE 




19.S044 


19.5044 


EVALTT 




68.6372 


68.6372 


CURCRE 




14.9469 


14.9469 


SEXF^l 




.2655 


.2655 


SBAM^l 




.3982 


.3982 


LABM^l 




.1416 


.1416 


SSM^l 




.0708 


.0708 


INSUl 




.4690 


.4690 


EXP^l 




(0 or 1)^ 


CO or 1}^ 


DISSON 






14.703 



0 = Control; 1 = Experimental 
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